Skip to content

Conversation

@Leemoonsoo
Copy link
Member

From ZEPL/zeppelin#388.

Update description of dependency loader to reflect ZEPL/zeppelin#319.
To do this, document structure is changed.

  • docs/zeppelincontext -> removed
  • interpreter/spark -> added (includes description about zeppelincontext and dependencyloader)

Ready to merge.

update description about dependency loader
@Leemoonsoo
Copy link
Member Author

I'm merging it if there's no discussions.

@asfgit asfgit closed this in b885ab7 Mar 30, 2015
asfgit pushed a commit that referenced this pull request Dec 23, 2015
### What is this PR for?
This PR has for goal to allow the user to search through the code in all the paragraphs *and notebook names* in all the notebooks

It add a simple 'search bar' to the nav-bar of Zeppelin WebApp, and an in-memory fulltext search index of paragraphs to the backend.

The search is pretty basic now, fine-tuning it for better search over all types of source code will be a subject of further work.

### What type of PR is it?
Feature

### Todos
* [x] - Fix typos 💃 b853aa6
* [x] - fix js issue in js console felizbear 29da337
* [x] - update index on paragraph CRUD:
  - [x] Read (initial work)
  - [x] Create\Delete 825b266
  - [x] Update e915a69
  - [x] Delete paragraph
* [x] - add license to zeppelin-distribution/src/bin_license/LICENSE (backend for lucene, not sure about angular-resource as it is part of the AngularJS codebase, but will add just in case) c00b516
* [x] - add missing Apache headers ded9c3b felizbear 29da337
* [x] - fix CI (~~was failing RAT on zengine Too many files with unapproved license: 2~~, now flacky integration test AKA [ZEPPELIN-510](https://issues.apache.org/jira/browse/ZEPPELIN-510))
* [x] - index notebook names e80c3e5, felizbear 29da337
* [x] - make NotebookRepoSync.sync() package private again  5a18bc8
* [x] - NPE on persisting changes of existing notebook
* [x] - reduce log verbosity

### Is there a relevant Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-501

### How should this be tested?
Outline the steps to test the PR here.

### Screenshots (if appropriate)
![screen shot 2015-12-15 at 19 49 18](https://cloud.githubusercontent.com/assets/5582506/11808681/34d004e8-a365-11e5-9452-ea616029073c.png)

![screen shot 2015-12-15 at 19 52 03](https://cloud.githubusercontent.com/assets/5582506/11808699/5dc023ce-a365-11e5-953d-c23235446f9c.png)

### Questions:
* Does the licenses files need update? Yes, added to license files
* Is there breaking changes for older versions? No
* Does this needs documentation? Yes

This work is a collaboration with felizbear who contributed major parts of the frontend changes.

Author: Alexander Bezzubov <bzz@apache.org>
Author: felizbear <ilya@nflabs.com>
Author: Alexander <abezzubov@nflabs.com>

Closes #534 from bzz/notebook-search and squashes the following commits:

c7f1d35 [Alexander Bezzubov] ZEPPELIN-501: refactoring, extract SearchService interface + Lucen-based impl
e3af25c [Alexander Bezzubov] ZEPPELIN-501: muting more search logs info->debug
c77d53b [Alexander Bezzubov] ZEPPELIN-501: fix + test for bug in index key structure
78f69a3 [Alexander Bezzubov] ZEPPELIN-501: update index on paragraph delete
73a28bb [Alexander Bezzubov] ZEPPELIN-501: fix NPE on Note creation by NotebookRepo, \wo DI constructor
cf44b1f [Alexander Bezzubov] ZEPPELIN-501: fix NPE on double-delete
d2b44ac [Alexander Bezzubov] ZEPPELIN-501: stop printing whole note in logs
f30e6c8 [Alexander Bezzubov] Merge branch 'master' into notebook-search
da69c07 [Alexander Bezzubov] ZEPPELIN-501: validate notes before update index
5f47890 [Alexander Bezzubov] ZEPPELIN-501: fix bug (merge artefact) that failed CI befor
e915a69 [Alexander Bezzubov] ZEPPELIN-501: update notebooks on save + tests
3f20904 [Alexander Bezzubov] ZEPPELIN-501: refactoring, compiler warning in Paragraph.java
40cf9e8 [Alexander Bezzubov] ZEPPELIN-501: refactoring, cleaning compiler warnings in Notebook.java
6a3906f [Alexander Bezzubov] Merge branch 'master' into notebook-search
2b2f8dc [Alexander Bezzubov] Merge branch 'master' into notebook-search
44235eb [Alexander Bezzubov] ZEPPELIN-501: refactoring, cleaning compiler warnings in Note.java
eb7878a [Alexander Bezzubov] Merge branch 'master' into notebook-search
0ce8a92 [Alexander Bezzubov] ZEPPELIN-501: add missing logger
6da1dc9 [Alexander Bezzubov] Merge branch 'master' into notebook-search
8c0f29a [Alexander Bezzubov] ZEPPELIN-501: fixing NPE in tests \w mocks
825b266 [Alexander Bezzubov] ZEPPELIN-501: refactoring + handling index Create\Delete
b13d5fb [Alexander Bezzubov] Merge branch 'master' into notebook-search
009b290 [Alexander Bezzubov] ZEPPELIN-501: muting logs back
0efc00e [Alexander Bezzubov] Merge branch 'master' into notebook-search
b0b2c54 [Alexander Bezzubov] ZEPPELIN-501: refactoring, renames + verbose logging ON
36b2467 [Alexander Bezzubov] ZEPPELIN-501: add default val for Note.name
c7ae983 [Alexander Bezzubov] Merge branch 'master' into notebook-search
ded9c3b [Alexander Bezzubov] ZEPPELIN-501: adding missing license headers
cd2173e [Alexander Bezzubov] ZEPPELIN-501: tixing fypo in docs, again 🙈
1952847 [Alexander Bezzubov] ZEPPELIN-501: minor test update
6180c86 [Alexander Bezzubov] ZEPPELIN-501: mute logs, invalid notes do not fail all indexing
29da337 [Alexander] Merge pull request #7 from felizbear/search-fix
c00b516 [Alexander Bezzubov] ZEPPELIN-501: update LICENCE file with new deps
5a18bc8 [Alexander Bezzubov] ZEPPELIN-501: restore NotebookRepoSync.sync() visibility + compiler warning cleanup
fcbff3d [felizbear] add missing apache license info to a source file
00f0315 [felizbear] handle notebooks is search results
7d06686 [felizbear] fix search-related bug in notebook controller
e80c3e5 [Alexander Bezzubov] ZEPPELIN-501: Indexing notebook names
b853aa6 [Alexander Bezzubov] ZEPPELIN-501: fixing typos in docs
82c7dd7 [Alexander Bezzubov] ZEPPELIN-501: reverting accidental changes
71ec51f [felizbear] clear search field on navigation to home view (/)
1e1357c [felizbear] redirect to notebook and scroll to paragraph from search view
09d44d2 [Alexander Bezzubov] Search: re-index note on every change
b2b93c4 [Alexander Bezzubov] Search: refatoring, move SearchService from NotebookRepoSync -> Notebook
08fe806 [Alexander Bezzubov] Search: adding tests
63a4e05 [Alexander Bezzubov] Search: adding search API docs
98f4e59 [Alexander Bezzubov] Search: refactoring, rename fragment -> snippet
5c1e3e4 [Alexander Bezzubov] Refatoring - removing old annotations
e363ed4 [Alexander Bezzubov] Search: make jshint happy
7aad5cf [Alexander Bezzubov] Search: make checkstyle happy
6ccd6f1 [Alexander Bezzubov] Search: nuke compiler warnings in NotebookRestApi
aa5ddb3 [felizbear] center search results on screen
227c6b4 [felizbear] update search results view: add panels for results
865925c [felizbear] highlight syntax and search terms in search results
9ca8628 [Alexander Bezzubov] Search: merge first 3 fragments + full paragraph in search result
11127f0 [felizbear] style search widget for notebook search
db246fa [Alexander Bezzubov] Search: highlighting added using fragments
c2c2a52 [Alexander Bezzubov] Search: backend indexing using Lucene added to zengine
163a465 [Alexander Bezzubov] Search: add search/result-list and switch to
bc2458a [Alexander Bezzubov] Get rid of compiler warnings
3900b60 [Alexander Bezzubov] Search: disabling UI on disconnect
7880237 [Alexander Bezzubov] Search: backend REST API scetch /notebooks/search?q=... added
c5928f9 [Alexander Bezzubov] Search: form added to navbar in frontend
asfgit pushed a commit that referenced this pull request Jan 22, 2016
1)  Rest apis to export notebook as JSON
2)  Rest api to import notebook from JSON
https://issues.apache.org/jira/browse/ZEPPELIN-590

Author: swakrish <swakrish@gmail.com>
Author: Ramaswamy Devarajan <ram.devarajan@us.ibm.com>

Closes #614 from swakrish/master and squashes the following commits:

83e7a6d [swakrish] Merge pull request #7 from apache/master
042d9af [swakrish] Merge pull request #6 from apache/master
f5b0805 [swakrish] Merge branch 'master' of git@github.com:swakrish/incubator-zeppelin.git
869b48f [swakrish] logging the error
f8bf1f3 [swakrish] Merge pull request #5 from apache/master
f8a992c [swakrish] Merge branch 'master' of git@github.com:swakrish/incubator-zeppelin.git
270e17b [swakrish] changed soureJSON to sourceJson
4cb69be [swakrish] Merge pull request #4 from apache/master
e282958 [swakrish] Changed websocket import to use common code
e928c14 [swakrish] changed doc to make it http post
4be62f6 [swakrish] Merge branch 'master' of git@github.com:swakrish/incubator-zeppelin.git
db6a580 [swakrish] changed HTTP Put to POST in the docs
ec14034 [swakrish] Merge pull request #3 from apache/master
630664c [swakrish] Merge pull request #2 from apache/master
b080d7d [swakrish] Merge pull request #1 from apache/master
db8b016 [Ramaswamy Devarajan] added note not found check for export
7351f31 [Ramaswamy Devarajan] Moved export/import methods to Notebook.java
6c19668 [Ramaswamy Devarajan] Changed http put to Http post for REST import
ecb8f1e [Ramaswamy Devarajan] Formatting for google style
9b64a66 [Ramaswamy Devarajan] fixed alignments
0e94dce [Ramaswamy Devarajan] add documentation
3645354 [Ramaswamy Devarajan] Rest Apis to export/import
asfgit pushed a commit that referenced this pull request Jun 30, 2016
### What is this PR for?
This PR is for supporting various Credential APIs for users.

### What type of PR is it?
Improvement

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1023

### How should this be tested?
  - to create credential information.
```
curl -XPUT -H "Content-Type: application/json" "http://localhost:8080/api/credential" -d '{"entity" : "e1", "username" : "user1", "password" : "testpass"}'
```

  - to get credential information.
```
curl -XGET -H "Content-Type: application/json" "http://localhost:8080/api/credential"
```

  - to remove credential entity information.
```
curl -XDELETE -H "Content-Type: application/json" "http://localhost:8080/api/credential/e1"
```

  - to remove all credential information.
```
curl -XDELETE -H "Content-Type: application/json" "http://localhost:8080/api/credential"
```

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no

Author: astroshim <hsshim@nflabs.com>
Author: AhyoungRyu <fbdkdud93@hanmail.net>
Author: HyungSung <hsshim@nflabs.com>

Closes #1030 from astroshim/ZEPPELIN-1023 and squashes the following commits:

1b94ae1 [astroshim] Merge branch 'master' into ZEPPELIN-1023
a580476 [astroshim] erase comment code
0609931 [astroshim] update credentialsMap
0f503fd [astroshim] to fix ci
d0c2bac [astroshim] changed syncronizedmap to concurrenthashmap
7b2a7c5 [HyungSung] Merge pull request #7 from AhyoungRyu/ZEPPELIN-1023-docs
80d8a30 [AhyoungRyu] Add rest-credential.md to index.md & dropdown menu
f546532 [astroshim] add rest-credential document
26433f2 [astroshim] change using syncronizedMap.
9b2c1c9 [astroshim] add checking null and blank values in the putCredentials method.
0371701 [astroshim] add more credential apis.
asfgit pushed a commit that referenced this pull request Sep 27, 2016
## What is this PR for?
The PR is a interpreter for [Apache Beam](http://beam.incubator.apache.org) which is an open source unified platform for data processing pipelines. A pipeline can be build using one of the Beam SDKs.
The execution of the pipeline is done by different Runners . Currently, Beam supports Apache Flink Runner, Apache Spark Runner, and Google Dataflow Runner.

### What type of PR is it?
- Feature

### Todos
* Test case
* Review Comments
* Documentation

### What is the Jira issue?
* [ZEPPELIN-682]

### How should this be tested?
- Start the Zeppelin server
- The prefix of interpreter is `%beam` and then write your code with required imports and the runner

### Screenshots (if appropriate)
![](https://s9.postimg.org/s6eiwrbxb/beam_interpreter.png)
![](https://s9.postimg.org/eq3h8wsrz/visualisation_with_table.png)

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? yes

Author: mahmoudelgamal <mahmoudf.elgamal@gmail.com>
Author: mfelgamal <mahmoudf.elgamal@gmail.com>
Author: Fouad <fuad.assayadi@gmail.com>

Closes #1334 from mfelgamal/beam-interpreter-static-repl-7 and squashes the following commits:

da66c27 [mahmoudelgamal] Modify condition of checking static modifier
55c1322 [mahmoudelgamal] set spark version to 1.6.2 and throw original exception
27d7690 [mahmoudelgamal] set spark version to 1.6.1 and some modifications
750041c [mahmoudelgamal] Add readme file and modify pom file and travis.yml
ca88f94 [mahmoudelgamal] edit pom file and .travis.yml
3d65427 [mahmoudelgamal] update .travis.yml file
f19f98d [mahmoudelgamal] Make easy example with imports ands some modifications
74c14ca [mahmoudelgamal] Update the licenses
acc7afb [mahmoudelgamal] Change beam to version 0.2.0
e821614 [mahmoudelgamal] Removing hadoop-core and print stack trace to failure
5cb7c7b [mahmoudelgamal] Add some changes to doc and pom file
75fc4f7 [mahmoudelgamal] add interpreter to navigation.html and remove extra spaces and lines
9b1b385 [mahmoudelgamal] put beam in alphabetical order
9c1e25d [mahmoudelgamal] Adding changes like logging and conventions and license
2aa6d65 [mahmoudelgamal] changing class name to StaticRepl and adding some modifications
7cf25fb [mahmoudelgamal] Adding some tests
3c5038f [mahmoudelgamal] Modifying the documentation
5695077 [mahmoudelgamal] Modifying pom file and Making documentation
26fc59b [mahmoudelgamal] Refactoring of the code
3a2bd85 [mahmoudelgamal] Adding the beam to zeppelin 7
ab7ee2d [mahmoudelgamal] beam interpreter
85957ff [mfelgamal] Merge pull request #10 from apache/master
852c3d3 [mfelgamal] Merge pull request #9 from apache/master
a4bcc0d [mfelgamal] Merge pull request #8 from apache/master
858f1e1 [mfelgamal] Merge pull request #7 from apache/master
03a1e80 [mfelgamal] Merge pull request #4 from apache/master
2586651 [Fouad] Merge pull request #2 from apache/master
pedrozatta pushed a commit to pedrozatta/zeppelin that referenced this pull request Oct 27, 2016
## What is this PR for?
The PR is a interpreter for [Apache Beam](http://beam.incubator.apache.org) which is an open source unified platform for data processing pipelines. A pipeline can be build using one of the Beam SDKs.
The execution of the pipeline is done by different Runners . Currently, Beam supports Apache Flink Runner, Apache Spark Runner, and Google Dataflow Runner.

### What type of PR is it?
- Feature

### Todos
* Test case
* Review Comments
* Documentation

### What is the Jira issue?
* [ZEPPELIN-682]

### How should this be tested?
- Start the Zeppelin server
- The prefix of interpreter is `%beam` and then write your code with required imports and the runner

### Screenshots (if appropriate)
![](https://s9.postimg.org/s6eiwrbxb/beam_interpreter.png)
![](https://s9.postimg.org/eq3h8wsrz/visualisation_with_table.png)

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? yes

Author: mahmoudelgamal <mahmoudf.elgamal@gmail.com>
Author: mfelgamal <mahmoudf.elgamal@gmail.com>
Author: Fouad <fuad.assayadi@gmail.com>

Closes apache#1334 from mfelgamal/beam-interpreter-static-repl-7 and squashes the following commits:

da66c27 [mahmoudelgamal] Modify condition of checking static modifier
55c1322 [mahmoudelgamal] set spark version to 1.6.2 and throw original exception
27d7690 [mahmoudelgamal] set spark version to 1.6.1 and some modifications
750041c [mahmoudelgamal] Add readme file and modify pom file and travis.yml
ca88f94 [mahmoudelgamal] edit pom file and .travis.yml
3d65427 [mahmoudelgamal] update .travis.yml file
f19f98d [mahmoudelgamal] Make easy example with imports ands some modifications
74c14ca [mahmoudelgamal] Update the licenses
acc7afb [mahmoudelgamal] Change beam to version 0.2.0
e821614 [mahmoudelgamal] Removing hadoop-core and print stack trace to failure
5cb7c7b [mahmoudelgamal] Add some changes to doc and pom file
75fc4f7 [mahmoudelgamal] add interpreter to navigation.html and remove extra spaces and lines
9b1b385 [mahmoudelgamal] put beam in alphabetical order
9c1e25d [mahmoudelgamal] Adding changes like logging and conventions and license
2aa6d65 [mahmoudelgamal] changing class name to StaticRepl and adding some modifications
7cf25fb [mahmoudelgamal] Adding some tests
3c5038f [mahmoudelgamal] Modifying the documentation
5695077 [mahmoudelgamal] Modifying pom file and Making documentation
26fc59b [mahmoudelgamal] Refactoring of the code
3a2bd85 [mahmoudelgamal] Adding the beam to zeppelin 7
ab7ee2d [mahmoudelgamal] beam interpreter
85957ff [mfelgamal] Merge pull request apache#10 from apache/master
852c3d3 [mfelgamal] Merge pull request apache#9 from apache/master
a4bcc0d [mfelgamal] Merge pull request apache#8 from apache/master
858f1e1 [mfelgamal] Merge pull request apache#7 from apache/master
03a1e80 [mfelgamal] Merge pull request apache#4 from apache/master
2586651 [Fouad] Merge pull request apache#2 from apache/master
Savalek pushed a commit to Savalek/zeppelin that referenced this pull request Jan 21, 2019
[ZP-13] By default create new note in "Users/user_name/"
asfgit pushed a commit that referenced this pull request Jul 12, 2020
…Interpreter database connection pool

### What is this PR for?
- Added support for personalized configuration of the JDBCInterpreter database connection pool.
- This feature can be used to solve the runtime error caused by HiveServer2 Session timeout.
- This connection pool configuration Compatible with [the official configuration of dbcp2 ](http://commons.apache.org/proper/commons-dbcp/configuration.html)

### What type of PR is it?
[Feature]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-4941

### How should this be tested?
* manually tested
* Supported configuration items
    - validationQuery
    - testOnBorrow
    - testOnCreate
    - testOnReturn
    - testWhileIdle
    - timeBetweenEvictionRunsMillis
    - maxWaitMillis
    - maxIdle
    - minIdle
    - maxTotal

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? NO
* Is there breaking changes for older versions? NO
* Does this needs documentation? NO

Author: xiejiajun <xiejiajun02@163.com>
Author: JakeXie <xiejiajun02@163.com>
Author: xie-jia-jun <xiejiajun02@163.com>

Closes #3844 from xiejiajun/jdbc-pool-config and squashes the following commits:

3bb622b [xiejiajun] use html table display datasource pool configuration in the jdbc.md document
88b1ce0 [xiejiajun] jdbc interpreter datasource connection pool  document
1f2eb55 [xiejiajun] Compatible with the official configuration of dbcp2 connection pool
5c7f666 [xiejiajun] JDBCInterprete supports personalized database connection pool configuration to cope with scenarios such as HiveSession timeout
3d57719 [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into apache-0.9
0e5f65a [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into apache-0.9
076668a [JakeXie] Merge pull request #7 from apache/branch-0.9
00e14dd [JakeXie] Merge pull request #5 from apache/branch-0.9
9bb7341 [xiejiajun] Merge remote-tracking branch 'origin/branch-0.9' into branch-0.9
9bc5605 [xiejiajun] bug fix:  when we removing a paragraph , an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete.
97d2714 [xie-jia-jun] Merge pull request #2 from apache/branch-0.9
9b3c744 [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly
asfgit pushed a commit that referenced this pull request Jul 12, 2020
…Interpreter database connection pool

### What is this PR for?
- Added support for personalized configuration of the JDBCInterpreter database connection pool.
- This feature can be used to solve the runtime error caused by HiveServer2 Session timeout.
- This connection pool configuration Compatible with [the official configuration of dbcp2 ](http://commons.apache.org/proper/commons-dbcp/configuration.html)

### What type of PR is it?
[Feature]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-4941

### How should this be tested?
* manually tested
* Supported configuration items
    - validationQuery
    - testOnBorrow
    - testOnCreate
    - testOnReturn
    - testWhileIdle
    - timeBetweenEvictionRunsMillis
    - maxWaitMillis
    - maxIdle
    - minIdle
    - maxTotal

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? NO
* Is there breaking changes for older versions? NO
* Does this needs documentation? NO

Author: xiejiajun <xiejiajun02@163.com>
Author: JakeXie <xiejiajun02@163.com>
Author: xie-jia-jun <xiejiajun02@163.com>

Closes #3844 from xiejiajun/jdbc-pool-config and squashes the following commits:

3bb622b [xiejiajun] use html table display datasource pool configuration in the jdbc.md document
88b1ce0 [xiejiajun] jdbc interpreter datasource connection pool  document
1f2eb55 [xiejiajun] Compatible with the official configuration of dbcp2 connection pool
5c7f666 [xiejiajun] JDBCInterprete supports personalized database connection pool configuration to cope with scenarios such as HiveSession timeout
3d57719 [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into apache-0.9
0e5f65a [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into apache-0.9
076668a [JakeXie] Merge pull request #7 from apache/branch-0.9
00e14dd [JakeXie] Merge pull request #5 from apache/branch-0.9
9bb7341 [xiejiajun] Merge remote-tracking branch 'origin/branch-0.9' into branch-0.9
9bc5605 [xiejiajun] bug fix:  when we removing a paragraph , an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete.
97d2714 [xie-jia-jun] Merge pull request #2 from apache/branch-0.9
9b3c744 [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly
asfgit pushed a commit that referenced this pull request Jul 16, 2020
…Spark Interpreter Scala REPL

### What is this PR for?
- Support for manually specifying the Java version of Spark Interpreter Scala REPL.
- This feature can be used to resolve runtime errors caused by reference to third-party libraries that use high-version Java in Spark Interpreter.
 
### What type of PR is it?
[Feature]

### Todos
* [ ] - Task

### What is the Jira issue?
*  https://issues.apache.org/jira/projects/ZEPPELIN/issues/ZEPPELIN-4950

### How should this be tested?
* manually tested
    *  Specify spark.repl.target through %spark.conf or when configuring Spark Interpreter
    *  Reference and call a Java method in a third-party library developed using Java 8 and using Java 8 features such as interface static methods through the Spark interpreter. If the call is successful, it means the test passed

### Screenshots (if appropriate)
- A runtime error will be triggered when  we reference a third-party library that uses the new features of Java8  if we using the default value `jvm-1.6`  of `settings.target.value` :
![image](https://user-images.githubusercontent.com/26395958/87297066-6581c580-c53a-11ea-989a-ad11001501f4.png)

### Questions:
* Does the licenses files need update? NO
* Is there breaking changes for older versions? NO
* Does this needs documentation? Yes

Author: xiejiajun <xiejiajun02@163.com>
Author: JakeXie <xiejiajun02@163.com>
Author: xie-jia-jun <xiejiajun02@163.com>

Closes #3852 from xiejiajun/spark_repl_target and squashes the following commits:

d131f19 [xiejiajun] spark.md docs fix
6872054 [xiejiajun] add spark.repl.target to spark.md docs
6a05b4f [xiejiajun] Support for manually specifying the Java version of Spark Interpreter Scala REPL  
6a2cf04 [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into branch-0.9
076668a [JakeXie] Merge pull request #7 from apache/branch-0.9
00e14dd [JakeXie] Merge pull request #5 from apache/branch-0.9
9bb7341 [xiejiajun] Merge remote-tracking branch 'origin/branch-0.9' into branch-0.9
9bc5605 [xiejiajun] bug fix:  when we removing a paragraph , an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete.
97d2714 [xie-jia-jun] Merge pull request #2 from apache/branch-0.9
9b3c744 [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly
asfgit pushed a commit that referenced this pull request Jul 16, 2020
…Spark Interpreter Scala REPL

### What is this PR for?
- Support for manually specifying the Java version of Spark Interpreter Scala REPL.
- This feature can be used to resolve runtime errors caused by reference to third-party libraries that use high-version Java in Spark Interpreter.
 
### What type of PR is it?
[Feature]

### Todos
* [ ] - Task

### What is the Jira issue?
*  https://issues.apache.org/jira/projects/ZEPPELIN/issues/ZEPPELIN-4950

### How should this be tested?
* manually tested
    *  Specify spark.repl.target through %spark.conf or when configuring Spark Interpreter
    *  Reference and call a Java method in a third-party library developed using Java 8 and using Java 8 features such as interface static methods through the Spark interpreter. If the call is successful, it means the test passed

### Screenshots (if appropriate)
- A runtime error will be triggered when  we reference a third-party library that uses the new features of Java8  if we using the default value `jvm-1.6`  of `settings.target.value` :
![image](https://user-images.githubusercontent.com/26395958/87297066-6581c580-c53a-11ea-989a-ad11001501f4.png)

### Questions:
* Does the licenses files need update? NO
* Is there breaking changes for older versions? NO
* Does this needs documentation? Yes

Author: xiejiajun <xiejiajun02@163.com>
Author: JakeXie <xiejiajun02@163.com>
Author: xie-jia-jun <xiejiajun02@163.com>

Closes #3852 from xiejiajun/spark_repl_target and squashes the following commits:

d131f19 [xiejiajun] spark.md docs fix
6872054 [xiejiajun] add spark.repl.target to spark.md docs
6a05b4f [xiejiajun] Support for manually specifying the Java version of Spark Interpreter Scala REPL  
6a2cf04 [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into branch-0.9
076668a [JakeXie] Merge pull request #7 from apache/branch-0.9
00e14dd [JakeXie] Merge pull request #5 from apache/branch-0.9
9bb7341 [xiejiajun] Merge remote-tracking branch 'origin/branch-0.9' into branch-0.9
9bc5605 [xiejiajun] bug fix:  when we removing a paragraph , an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete.
97d2714 [xie-jia-jun] Merge pull request #2 from apache/branch-0.9
9b3c744 [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly

(cherry picked from commit 054651f)
Signed-off-by: Jeff Zhang <zjffdu@apache.org>
prabhjyotsingh pushed a commit to prabhjyotsingh/zeppelin that referenced this pull request Aug 14, 2020
…Interpreter database connection pool

### What is this PR for?
- Added support for personalized configuration of the JDBCInterpreter database connection pool.
- This feature can be used to solve the runtime error caused by HiveServer2 Session timeout.
- This connection pool configuration Compatible with [the official configuration of dbcp2 ](http://commons.apache.org/proper/commons-dbcp/configuration.html)

### What type of PR is it?
[Feature]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-4941

### How should this be tested?
* manually tested
* Supported configuration items
    - validationQuery
    - testOnBorrow
    - testOnCreate
    - testOnReturn
    - testWhileIdle
    - timeBetweenEvictionRunsMillis
    - maxWaitMillis
    - maxIdle
    - minIdle
    - maxTotal

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? NO
* Is there breaking changes for older versions? NO
* Does this needs documentation? NO

Author: xiejiajun <xiejiajun02@163.com>
Author: JakeXie <xiejiajun02@163.com>
Author: xie-jia-jun <xiejiajun02@163.com>

Closes apache#3844 from xiejiajun/jdbc-pool-config and squashes the following commits:

3bb622b [xiejiajun] use html table display datasource pool configuration in the jdbc.md document
88b1ce0 [xiejiajun] jdbc interpreter datasource connection pool  document
1f2eb55 [xiejiajun] Compatible with the official configuration of dbcp2 connection pool
5c7f666 [xiejiajun] JDBCInterprete supports personalized database connection pool configuration to cope with scenarios such as HiveSession timeout
3d57719 [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into apache-0.9
0e5f65a [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into apache-0.9
076668a [JakeXie] Merge pull request apache#7 from apache/branch-0.9
00e14dd [JakeXie] Merge pull request apache#5 from apache/branch-0.9
9bb7341 [xiejiajun] Merge remote-tracking branch 'origin/branch-0.9' into branch-0.9
9bc5605 [xiejiajun] bug fix:  when we removing a paragraph , an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete.
97d2714 [xie-jia-jun] Merge pull request #2 from apache/branch-0.9
9b3c744 [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly
prabhjyotsingh pushed a commit to prabhjyotsingh/zeppelin that referenced this pull request Aug 14, 2020
…Spark Interpreter Scala REPL

### What is this PR for?
- Support for manually specifying the Java version of Spark Interpreter Scala REPL.
- This feature can be used to resolve runtime errors caused by reference to third-party libraries that use high-version Java in Spark Interpreter.
 
### What type of PR is it?
[Feature]

### Todos
* [ ] - Task

### What is the Jira issue?
*  https://issues.apache.org/jira/projects/ZEPPELIN/issues/ZEPPELIN-4950

### How should this be tested?
* manually tested
    *  Specify spark.repl.target through %spark.conf or when configuring Spark Interpreter
    *  Reference and call a Java method in a third-party library developed using Java 8 and using Java 8 features such as interface static methods through the Spark interpreter. If the call is successful, it means the test passed

### Screenshots (if appropriate)
- A runtime error will be triggered when  we reference a third-party library that uses the new features of Java8  if we using the default value `jvm-1.6`  of `settings.target.value` :
![image](https://user-images.githubusercontent.com/26395958/87297066-6581c580-c53a-11ea-989a-ad11001501f4.png)

### Questions:
* Does the licenses files need update? NO
* Is there breaking changes for older versions? NO
* Does this needs documentation? Yes

Author: xiejiajun <xiejiajun02@163.com>
Author: JakeXie <xiejiajun02@163.com>
Author: xie-jia-jun <xiejiajun02@163.com>

Closes apache#3852 from xiejiajun/spark_repl_target and squashes the following commits:

d131f19 [xiejiajun] spark.md docs fix
6872054 [xiejiajun] add spark.repl.target to spark.md docs
6a05b4f [xiejiajun] Support for manually specifying the Java version of Spark Interpreter Scala REPL  
6a2cf04 [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into branch-0.9
076668a [JakeXie] Merge pull request apache#7 from apache/branch-0.9
00e14dd [JakeXie] Merge pull request apache#5 from apache/branch-0.9
9bb7341 [xiejiajun] Merge remote-tracking branch 'origin/branch-0.9' into branch-0.9
9bc5605 [xiejiajun] bug fix:  when we removing a paragraph , an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete.
97d2714 [xie-jia-jun] Merge pull request #2 from apache/branch-0.9
9b3c744 [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly

(cherry picked from commit 054651f)
Signed-off-by: Jeff Zhang <zjffdu@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant